Information processing system, information processing device, control method, and storage medium

ABSTRACT

An information processing system including a communication unit that acquires information related to an interaction between objects from a sensing device that detects the interaction between the objects, an emotion information database constructed by accumulating an evaluation value used when an emotion value of each object generated based on the information related to the interaction between the objects is calculated, a certification unit that certifies the sensing device and issues certification information to the sensing device, and an authentication unit that authenticates the information related to the interaction transmitted from the sensing device based on the certification information issued to the sensing device.

CROSS-REFERENCES TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 15/546,450, filed Jul. 26, 2017, which is aNational Stage Entry of PCT/JP2015/082269, filed Nov. 17, 2015, whichclaims the benefit of priority from Japanese Patent Application No. JP2015-026239, filed in the Japan Patent Office on Feb. 13, 2015. Each ofthe above-referenced applications is hereby incorporated herein byreference in its entirety.

TECHNICAL FIELD

The present disclosure relates to an information processing system, aninformation processing device, a control method, and a storage medium.

BACKGROUND ART

In the related art, the following technologies for reliability ofconstructed databases have been proposed.

For example, the following Patent Literature 1 discloses a system inwhich a user can input his or her emotion directly or input his or heremotion in accordance with a manipulation such as clicking of a mouse,and thus a change in an emotion of the user can be ascertained inaccordance with certainty based on the time from the input.

In addition, the following Patent Literature 2 discloses a systemcapable of maintaining privacy by enabling a patient to set anoff-record mode and improving reliability of an entire communicationrecord system in a system in which conversation between a doctor and apatient is recorded.

CITATION LIST Patent Literature

Patent Literature 1:

JP 2005-339368A

Patent Literature 2:

JP 2005-260944A DISCLOSURE OF INVENTION Technical Problem

However, technologies of the related art have not mentioned maintenanceof reliability of an emotion value which is a new index objectivelyindicating an emotion, a thought, a value, reliability, humanity, or thelike of an object generated on the basis of a history of an interactionoccurring between objects including all articles and people.

Accordingly, the present disclosure proposes an information processingsystem, an information processing device, a control method, and astorage medium capable of maintaining or improving reliability of anemotion value.

Solution to Problem

According to the present disclosure, there is proposed an informationprocessing system including: a communication unit configured to acquireinformation related to an interaction between objects from a sensingdevice that detects the interaction between the objects; an emotioninformation database constructed by accumulating an evaluation valueused when an emotion value of each object generated on the basis of theinformation related to the interaction between the objects iscalculated; a certification unit configured to certify the sensingdevice that detects the interaction between the objects and issuecertification information to the sensing device; and an authenticationunit configured to authenticate the information related to theinteraction transmitted from the sensing device on the basis of thecertification information issued to the sensing device.

According to the present disclosure, there is proposed an informationprocessing device including: an extraction unit configured to extractinformation related to an interaction between objects detected by asensor in connection with each object; a communication unit configuredto transmit information regarding the sensor and the information relatedto the interaction detected by the sensor to a server including anemotion information database constructed by accumulating an evaluationvalue used when an emotion value of each object generated on the basisof the information related to the interaction between the objects iscalculated; and a certification information storage unit configured toreceive certification information indicating a result obtained when theserver certifies an information processing device including the sensoron the basis of the information related to the interaction detected bythe sensor via the communication unit, and store the certificationinformation.

According to the present disclosure, there is proposed a control methodincluding: acquiring information related to an interaction betweenobjects from a sensing device that detects the interaction between theobjects; constructing an emotion information database by accumulating anevaluation value used when an emotion value of each object generated onthe basis of the information related to the interaction between theobjects is calculated; certifying, by a certification unit, the sensingdevice that detects the interaction between the objects and issuingcertification information to the sensing device; and authenticating, byan authentication unit, the information related to the interactiontransmitted from the sensing device on the basis of the certificationinformation issued to the sensing device.

According to the present disclosure, there is proposed a storage mediumhaving a program stored therein, the program causing a computer tofunction as: an extraction unit configured to extract informationrelated to an interaction between objects detected by a sensor inconnection with each object; a communication unit configured to transmitinformation regarding the sensor and the information related to theinteraction detected by the sensor to a server including an emotioninformation database constructed by accumulating an evaluation valueused when an emotion value of each object generated on the basis of theinformation related to the interaction between the objects iscalculated; and a certification information storage unit configured toreceive certification information indicating a result obtained when theserver certifies an information processing device including the sensoron the basis of the information related to the interaction detected bythe sensor via the communication unit, and store the certificationinformation.

Advantageous Effects of Invention

According to the present disclosure, as described above, it is possibleto maintain or improve reliability of an emotion value.

Note that the effects described above are not necessarily limitative.With or in the place of the above effects, there may be achieved any oneof the effects described in this specification or other effects that maybe grasped from this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an explanatory diagram illustrating an overview of aninformation processing system according to an embodiment of the presentdisclosure.

FIG. 2 is a diagram illustrating the configuration of the entireinformation processing system according to the embodiment.

FIG. 3 is a diagram illustrating an example of the configuration of acertification server according to the embodiment.

FIG. 4 is a diagram illustrating an example of the configuration of asensing device according to the embodiment.

FIG. 5 is a diagram illustrating an example of the configuration of anemotion server according to the embodiment.

FIG. 6 is a flowchart illustrating a registration process for a newsensing device according to the embodiment.

FIG. 7 is a sequence diagram illustrating a certification process for asensing device individual according to the embodiment.

FIG. 8 is a sequence diagram illustrating a periodic certificationprocess according to the embodiment.

FIG. 9 is a flowchart illustrating a certification confirmation processwhen certification is rejected.

FIG. 10 is a sequence diagram illustrating a certification process forthe sensing device in accordance with feedback of a user according tothe embodiment.

FIG. 11 is an explanatory diagram illustrating a case in which aplurality of sensing devices detect the same interaction.

FIG. 12 is a flowchart illustrating a notification process according tothe embodiment.

FIG. 13 is a flowchart illustrating an approval process according to theembodiment.

FIG. 14 is a flowchart illustrating an approval setting process in eachplace according to the embodiment.

FIG. 15 is a flowchart illustrating an automatic approval settingprocess for surrounding sensing devices according to the embodiment.

FIG. 16 is a flowchart illustrating an operation process of the sensingdevice in accordance with approval setting according to the embodiment.

FIG. 17 is an explanatory diagram illustrating registration ofinteraction information from surrounding sensing devices when a givencondition is satisfied according to the embodiment.

FIG. 18 is a flowchart illustrating a registration approval processaccording to the embodiment.

FIG. 19 is an explanatory diagram illustrating an environment adjustmentsystem in which an emotion value is used according to the embodiment.

FIG. 20 is a sequence diagram illustrating an access permission processaccording to the embodiment.

FIG. 21 is a sequence diagram illustrating another access approvalprocess according to the embodiment.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. In thisspecification and the appended drawings, structural elements that havesubstantially the same function and structure are denoted with the samereference numerals, and repeated explanation of these structuralelements is omitted.

The description will be made in the following order.

1. Overview of information processing system according to embodiment ofthe present disclosure

2. Configuration

2-1. Entire configuration2-2. Configuration of certification server2-3. Configuration of sensing device2-4. Configuration of emotion server3. Operation process3-1. Certification process for new sensing device3-2. Periodic certification process for sensing device3-3. Certification process in accordance with feedback3-4. Certification process based on interaction evaluation value3-5. Approval process3-6. Access approval process

4. Conclusion 1. OVERVIEW OF INFORMATION PROCESSING SYSTEM ACCORDING TOEMBODIMENT OF THE PRESENT DISCLOSURE

First, an overview of an information processing system according to anembodiment of the present disclosure will be described with reference toFIG. 1. An information processing system 100 according to the embodimentincludes a sensing device 2 that detects an interaction occurringbetween objects, a certification server 1, and an emotion server 3, asillustrated in FIG. 1, and maintains or improves reliability of anemotion value of an object calculated on the basis of interactioninformation detected by the sensing device 2.

Specifically, first, an interaction between a plurality of objects, forexample, an interaction occurring between a user Obj.A (which is anexample of an object) and a watch Obj.B (which is an example of anobject) illustrated in FIG. 1 (that is, maintenance of a watch), isdetected by the sensing device 2 (a: detecting an interaction). Here, inthe example illustrated in FIG. 1, a state in which the sensing device 2is installed around the object is illustrated, but the embodiment is notlimited thereto. For example, the sensing device 2 may be mounted/loadedon the object or may be loaded on an information processing terminalworn by the object. In addition, the present disclosure is not limitedto the case in which the sensing device 2 is realized by a cameracapable of image analysis. For example, a vibration sensor, anacceleration sensor, a gyro sensor, a temperature sensor, a humiditysensor, an infrared sensor, a depth sensor, a tactile sensor, abiosensor, or a microphone may be used.

Subsequently, the sensing device 2 extracts information related to aninteraction (hereinafter also referred to as interaction information) onthe basis of detected sensing data and transmits the information to theemotion server 3 (b: transmitting the interaction information). Forexample, the sensing device 2 extracts interaction information “UserObj.A performs maintenance on the watch Obj.B/at 00:00 0 on month day”and transmits the interaction information to the emotion server 3.

The emotion server 3 registers the interaction information between theobjects transmitted from the sensing device 2 (stores the interactioninformation in a database) and calculates emotion values of the objectson the basis of the accumulated interaction information (also referredto as a history of the interaction information). For example, when theobject is a person, the emotion value calculated by the emotion server 3is used as a new index objectively indicating personality or humanity ofthe person (for example, whether the person is reliable or rude) or athought of the person for a specific object (for example, the personvalues the object or thinks that the object is valuable). Specifically,for example, the emotion value is used as credit information of a targetperson, an exhibitor, or a buyer in a personal credit informationprovision system or an auction system. The emotion value is used toascertain humanity or reliability of a communication partner at the timeof setting a privacy level in a telepresence system. In addition, in anenvironment adjustment system in which a surrounding environment of atarget user is locally changed (for example, rain or sunshine isprevented from falling on a user) by a moving object such as a drone,the emotion value is used when an article carried by the user or a moodof the user with respect to a person staying together is ascertained anda coverage range is controlled.

In addition, when the object is an article, the emotion value is used asa new index objectively indicating a “thought” about receiving anarticle, such as that the article has been treated with care or treatedrecklessly until now. For example, the emotion value is used as aconnotative value of an exhibited item in an auction system.

To maintain or improve reliability of the emotion value used in varioussystems, first, it is necessary that interaction information registeredin a database constructed in the emotion server 3 be correct. Forexample, when the same interaction information is transmitted to theemotion server 3 several times, precision of a sensor or extractionprecision of an interaction is lowered, or a different interaction froman actual interaction is extracted due to an erroneous operation of thesensing device 2, an accurate emotion value is not calculated andreliability of the entire system is lowered.

Accordingly, in view of the foregoing circumstances, by certifying thesensing device 2 that detects an interaction in the informationprocessing system according to the present disclosure, it is possible tomaintain or improve the reliability of the emotion value.

More specifically, as illustrated in FIG. 1, the information processingsystem 100 according to the embodiment is configured such that the userObj.A can be notified of information on an interaction occurring betweenthe user Obj.A and the watch Obj.B registered in the emotion server 3and it can be confirmed whether the interaction information is correctlyregistered (c: notifying of the registered interaction information).

The user confirms whether the registered interaction information iscorrect and feeds evaluation of the sensing device 2 extracting theinteraction information back to the certification server 1 (d: feedbackby the user). The certification server 1 certifies the sensing device 2on the basis of the feedback (the evaluation of the sensing device 2)from the user.

Then, the certification server 1 transmits certification informationindicating a certification result (certification OK/NG) to the sensingdevice 2 and the emotion server 3 (e: notifying of the certificationresult and f: notifying of the certification result). The emotion server3 controls registration or non-registration of the interactioninformation transmitted from the sensing device 2 in the database on thebasis of the certification information (g: controlling registration ornon-registration). That is, when the sensing device 2 is certified, theemotion server 3 registers the interaction information. When thecertification is rejected, the emotion server 3 performs control suchthat the interaction information is discarded and not registered.

The overview of the information processing system according to theembodiment of the present disclosure has been described above. Next, theinformation processing system according to the present disclosure willbe described specifically.

2. CONFIGURATION

<2-1. Entire Configuration>

FIG. 2 is a diagram illustrating the configuration of the entireinformation processing system according to the embodiment of the presentdisclosure. As illustrated in FIG. 2, the information processing system100 includes the certification server 1, the sensing device 2, theemotion server 3, and a user terminal 5. The certification server 1, thesensing device 2, the emotion server 3, and the user terminal 5 can beconnected via a network 4.

As described above, the sensing device 2 extracts an interaction betweenobjects and transmits the interaction to the emotion server 3.

The emotion server 3 registers the interaction transmitted from thesensing device 2. In addition, the emotion server 3 transmitsinformation regarding the registered interaction to the user terminal 5.In addition, the emotion server 3 can determine registration ornon-registration of the interaction transmitted from the sensing device2 on the basis of a certification result from the certification server1.

The user terminal 5 displays the interaction information transmittedfrom the emotion server 3 and prompts the user to confirm theinteraction information. In addition, the user terminal 5 transmitsevaluation content input by the user to the certification server 1.Also, the user terminal 5 may be, for example, a smartphone, a mobilephone terminal, a personal computer, or a wearable terminal.

The certification server 1 certifies the sensing device 2 in accordancewith the evaluation content from the user terminal 5 and transmits acertification result to the sensing device 2 and the emotion server 3.In addition, the certification server 1 can also determine thecertification of the sensing device 2 in advance on the basis of deviceinformation or the like regarding the sensing device 2.

Hereinafter, each device included in the information processing system100 will be described specifically.

<2-2. Configuration of Certification Server>

FIG. 3 is a diagram illustrating an example of the configuration of thecertification server 1 according to the embodiment. As illustrated inFIG. 3, the certification server 1 includes a communication unit 11, acertification unit 12, a certification information input unit 13, acertification information DB 14, an individual information DB 15, and anindividual certification history DB 16.

The communication unit 11 exchanges information with an external devicevia the network 4. For example, the communication unit 11 receivessensing device individual information from the sensing device 2 orreceives feedback information of the sensing device 2 from the userterminal 5. In addition, the communication unit 11 transmitscertification information regarding the sensing device 2 to the sensingdevice 2 and the emotion server 3.

The certification unit 12 certifies the sensing device 2 and issuescertification information to the sensing device 2 and the emotion server3. Specifically, the certification unit 12 certifies the sensing device2 on the basis of the feedback information received from the userterminal 5. In addition, the certification unit 12 stores thecertification information in the individual certification history DB 16.When the certification unit 12 performs certification on the basis ofnew feedback information, the certification unit 12 updatescorresponding existing certification information. In addition, thecertification unit 12 can also certify the sensing device 2 withreference to a certification standard on the basis of the deviceinformation (property information indicating a function, performance, orthe like) acquired from the sensing device 2. The certification processby the certification unit 12 will be described in detail with referenceto FIGS. 6 to 12.

The certification information input unit 13 inputs information regardingthe certification, such as the certification standard or modelinformation regarding the sensing device 2 to be certified. Theabove-described certification unit 12 certifies the sensing device 2using the certification standard input from the certificationinformation input unit 13. In addition, the information regarding thecertification input from the certification information input unit 13 isstored in the certification information DB 14. In addition, thecertification information input unit 13 may be realized by amanipulation input unit (a keyboard, a mouse, a touch panel, or thelike) accepting an input by a system manager or the like or may berealized by a reception unit that communicates with an external terminaland accepts an input of the certification information.

The certification information DB 14 is a storage unit that stores thecertification standard and the model information regarding thecertification target sensing device 2. For example, as the certificationstandard, data indicating “face recognition frame rate: 15 fps or moreand average face recognition ratio: 50%” is stored. In addition, generalitem information (an item name, a model, a manufacturer, or the like)regarding the sensing device 2 to which the certification standard isapplied or an individual ID of the sensing device 2 managed in theinformation processing system 100 can also be stored. In addition, acertification state (certified/certification rejected) by a model isalso stored.

The individual information DB 15 is a storage unit that stores uniqueindividual information regarding the sensing device 2. For example, anindividual number (a serial number or the like) of the sensing device 2,corresponding model information, a model ID managed in the informationprocessing system 100, an individual ID, an individual certificationstate (certified/certification rejected), an introduction state in theinformation processing system 100 (introduced/unintroduced),authentication key information, and the like are stored.

The individual certification history DB 16 is a storage unit that storesan individual certification history of the sensing device 2. Forexample, a certification information history (a date, the certificationstandard, and a certification result) of an individual or a feedbackhistory (a date, a user evaluation value, and a certification result) ofa user is stored in association with the individual ID of the sensingdevice 2. For example, a data example of the individual certificationinformation history is shown in the following Table 1 and a data exampleof the feedback history of a user is shown in the following Table 2.

[Table 1]

TABLE 1 Individual Certification Certification ID Date standard result56789 2014 Nov. 1 frame rate = Average OK 15:00:00 10.0 recognitionaccuracy = 0.93

[Table 2]

TABLE 2 User Individual evaluation Certification ID Date (1-10) result56789 2014 Dec. 1 8 OK 15:00:00

In the above-described certification server 1, a microcomputer thatincludes a central processing unit (CPU), a read-only memory (ROM), arandom access memory (RAM), and a nonvolatile memory is loaded tocontrol each configuration of the certification server 1.

<2-3. Configuration of Sensing Device>

FIG. 4 is a diagram illustrating an example of the configuration of asensing device 2 according to the embodiment. As illustrated in FIG. 4,the sensing device 2 includes a sensor 21, an interaction extractionunit 22, a communication unit 23, and a certification informationstorage unit 24.

(Sensor)

The sensor 21 has a function of detecting an interaction betweenobjects. The sensor 21 is realized by, for example, a humidity sensor, atemperature sensor, a vibration sensor, an infrared sensor, a camera, atactile sensor, a gyro sensor, an illuminance sensor, a human detectionsensor, an atmospheric sensor (specifically, a dust sensor or acontaminant sensor), a speed sensor, or a number-of-times measurementvalue.

(Interaction Extraction Unit)

The interaction extraction unit 22 functions as a detection unit thatanalyzes sensing data output from the sensor 21 and detects informationrelated to an interaction between first and second objects. For example,the interaction extraction unit 22 specifically extracts an interaction(conversation, telephony, or presentation) between people or aninteraction between a person and an article (maintenance of an article,handling of an article, or a motion of a person on an article such as anaction in a shop).

(Communication Unit)

The communication unit 23 transmits information related to theinteraction extracted by the interaction extraction unit 22 to theemotion server 3 via the network 4. In addition, the communication unit23 receives certification information from the certification server 1.

(Certification Information Storage Unit)

The certification information storage unit 24 stores the certificationinformation transmitted from the certification server 1. Thecertification information includes a certification result obtained onthe sensing device 2 by the certification server 1.

A microcomputer that includes a CPU, a ROM, a RAM, and a nonvolatilememory is loaded on the above-described sensing device 2 and controlseach configuration of the sensing device 2.

<2-4. Configuration of Emotion Server>

FIG. 5 is a diagram illustrating an example of the configuration of theemotion server 3 according to the embodiment. As illustrated in FIG. 5,the emotion server 3 includes a controller 30, a communication unit 31,an object DB 32, an emotion information DB 33, a certificationinformation DB 34, and a permission information DB 35.

(Controller)

The controller 30 is configured with a microcomputer that includes aCPU, a ROM, a RAM, and a nonvolatile memory and controls eachconfiguration of the emotion server 3. In addition, as illustrated inFIG. 5, the controller 30 functions as an interaction storage controller30 a, an evaluation unit 30 b, an object management unit 30 c, a relatedobject search unit 30 d, an emotion value calculation unit 30 e, anauthentication unit 30 f, a notification controller 30 g, an approvalsetting unit 30 h, and an access permission setting unit 30 i.

The interaction storage controller 30 a performs control such that theinteraction information received from the sensing device 2 is stored inthe emotion information DB 33. In addition, the interaction storagecontroller 30 a according to the embodiment performs control such thatthe interaction information authenticated by the authentication unit 30f to be described below is stored in the emotion information DB 33. Inaddition, the interaction storage controller 30 a according to theembodiment may perform control such that an interaction of the object IDapproved by the approval setting unit 30 h to be described below or atype of approved interaction is stored in the emotion information DB 33.

The evaluation unit 30 b evaluates the interaction stored in the emotioninformation DB 33. A method of evaluating the interaction (behavior) isnot particularly limited. For example, the evaluation unit 30 b maygrant a score (evaluation value) of −1.0 to 1.0 on the basis of astandard decided with any evaluation index. The granted evaluation valueis stored in the emotion information DB 33 in association with theinteraction.

The object management unit 30 c performs management such asregistration, changing, and deletion of information regarding an objectstored in the object DB 32 (for example, the object ID, name, and type).

The related object search unit 30 d searches for a related object whichis another object in which an interaction occurs with the object IDrequested from an external device from an interaction history stored inthe emotion information DB 33 and searches for information regarding therelated object from the object DB 32.

The emotion value calculation unit 30 e calculates an emotion value ofthe requested object on the basis of evaluations values in associationwith interactions accumulated in the emotion information DB 33. A methodof calculating the emotion value is not particularly limited. Forexample, the emotion value calculation unit 20 e may calculate anabsolute emotion value of the requested object on the basis of a totalvalue of all the interaction evaluation values occurring between therequested object and other objects. In addition, the emotion valuecalculation unit 20 e may calculate the absolute emotion value of therequested object on the basis of an average value of all the interactionevaluation values. In addition, the emotion value calculation unit 20 ecan also perform weighting by the type of interaction and then calculatethe absolute emotion value on the basis of the total value, the averagevalue, or the like. Further, the emotion value calculation unit 20 e maycalculate a relative emotion value of the requested object on the basisof a total value, an average value, or the like of the interactionevaluation values occurring between the requested object and specific(or specific types of) objects. In addition, the emotion valuecalculation unit 20 e may also select an interaction history to be usedto calculate the emotion value in accordance with an emotion value useobjective of a request source and calculate the emotion value of therequested object.

The authentication unit 30 f has a function of authenticating storage(registration) of the information related to the interaction transmittedfrom the sensing device 2 in the certification information DB 34 on thebasis of the certification information issued from the certificationserver 1. The certification information is stored in the certificationinformation DB 34. Specifically, the authentication unit 30 fauthenticates the information related to the interaction transmittedfrom the sensing device 2 certified by the certification server 1.Conversely, the authentication unit 30 f does not authenticate theinformation related to the interaction transmitted from the sensingdevice 2 not certified by the certification server 1 or the sensingdevice 2 of which the certification is rejected by the certificationserver 1 and does not register the information in the emotioninformation DB 33.

The notification controller 30 g performs control such that a user isnotified of information related to an interaction occurring between anobject (user) and another object, extracted by the sensing device 2, andregistered in the emotion information DB 33. Thus, the user can confirmwhether the interaction occurring between the user and another object iscorrectly extracted and can feed evaluation for the sensing device 2extracting the interaction back (to the certification server 1).

The approval setting unit 30 h performs approval setting ofdetection/registration of an interaction occurring between a targetobject and another object. Specifically, for example, the approvalsetting unit 30 h sets approval of the detection/registration of theinteraction information for each object ID or type of interaction.Information regarding the approval setting is stored in thecertification information DB 34. In addition, the specific sensingdevice 2 is notified of the information regarding the approval setting.

For example, when a user allows aspects of his or her daily life at homesuch as cleaning of a watch and a conversation with another person to bedetected/registered as an interaction and desires to avoiddetection/registration of facial expressions, the user can avoid thedetection/registration not desired by the user by approving types ofinteractions of detection/registration OK or NG in advance. In this way,the detection/registration of the interaction according to theembodiment is not limited to the detection/registration of all theinteractions in the emotion information DB 33 by the certified sensingdevice 2, but the object ID/type of interaction set to be approved canalso be detected/registered.

In addition, for example, in a situation in which an interaction betweenobjects which are within a specific range can be extracted by thesensing device 2 installed in a public place, registration ornon-registration of an interaction in the public place can also beapproved for each user (that is, each object ID). For example, in aconference room of a business office, a restaurant, an event site, orthe like, a user entering that place can be notified of registration ornon-registration of an interaction in that place and approval settingcan be appropriately performed. An approval process by the approvalsetting unit 30 h will be described in detail with reference to FIGS. 13to 18.

The access permission setting unit 30 i has a function of performingpermission setting of access to an interaction evaluation value or anemotion value of the requested object ID from a third person.Specifically, the access permission setting unit 30 i permits the accessof the user to the interaction evaluation value or the emotion value toa specific third person (external device) in accordance with aninstruction from the user. Information regarding the permission(permission information) is stored in the permission information DB 35.Thus, for example, the emotion value calculation unit 30 e can preventunauthorized access by determining whether an external device of arequest source is permitted to access the emotion value or theinteraction evaluation value of the user with reference to thepermission information stored in the permission information DB 35. Anaccess permission setting process by the access permission setting unit30 i will be described in detail with reference to FIGS. 19 to 21.

(Communication Unit)

The communication unit 31 receives the interaction information from thesensing device 2 via the network 4 and receives the certificationinformation from the certification server 1. In addition, thecommunication unit 31 transmits the interaction information to the userterminal 5 via the network 4 in accordance with an instruction of thenotification controller 30 g.

In addition, the communication unit 31 transmits interaction evaluationstored in the emotion information DB 33 or an emotion value calculatedby the emotion calculation unit 30 e in accordance with a request froman external device.

(Object DB)

The object database (DB) 32 stores adjunctive information regarding eachobject, for example, a name (a personal name or an item name), a type(sex or category), identification information (a face image, biometricinformation, a serial number, a model, and a maker ID), in associationwith the object ID (including a person and an article).

(Emotion Information DB)

The emotion information DB 33 stores the interaction information betweenobjects to be used to calculate an emotion value. The interactioninformation includes, for example, the object ID for which aninteraction is performed/received, a date and a place in which theinteraction occurs, the related object ID (that is, a partner of theinteraction) related to the interaction, the type of interaction(conversation, telephony, mailing, maintenance, safekeeping, cleaning,discarding, purchase, donation, manipulation, use, or the like) relatedto the interaction, details of the interaction, and an evaluation value.

(Certification Information DB)

The certification information DB 34 stores certification informationregarding the sensing device 2 issued from the certification server 1.The certification information includes, for example, the individual IDof the sensing device 2 and a certification result(certified/uncertified/certification rejected).

(Permission Information DB)

The permission information DB 35 stores permission information regardingaccess permission of the interaction evaluation value or the emotionvalue to a third person by the access permission setting unit 30 i. Thepermission information includes, for example, the object ID of an accesstarget and the object ID of a permitted third person.

The configuration of the emotion server 3 according to the embodimenthas been described specifically above. Also, the configuration of theemotion server 3 is not limited to the example illustrated in FIG. 5 andmay also be configured not to include the approval setting unit 30 h orthe access permission setting unit 30 i. In addition, the object DB 32,the emotion information DB 33, the certification information DB 34, andthe permission information DB 35 may be stored in an external storagedevice on a network.

3. OPERATION PROCESS

Next, an operation process according to the embodiment will be describedspecifically with reference to the flowcharts and the sequence diagrams.

<3-1. Certification Process for New Sensing Device>

In the embodiment, certification of a new sensing device can also beperformed in advance in accordance with the certification standard. Forexample, certification is performed in accordance with whether theperformance of the sensing device 2 is greater than a predeterminedstandard. Thus, it is possible to avoid unauthorized extraction of aninteraction by the sensing device 2 and maintain reliability of theentire system. Hereinafter, the certification process for a new sensingdevice will be described with reference to FIGS. 6 and 7.

FIG. 6 is a flowchart illustrating a registration process for a newsensing device according to the embodiment. When the new sensing deviceis introduced in the system, information regarding the new sensingdevice is registered in the certification server 1.

First, in step S103 illustrated in FIG. 6, the certification server 1accepts an input of item information of the new sensing device.Specifically, general item information (the name, model, manufacturer,and the like of the item) of the new sensing device can be input fromthe certification information input unit 13 by a manager.

Next, in step S106, the certification server 1 accepts an input of thecertification standard of the new sensing device. Specifically, thecertification standard (a performance condition or the like necessaryfor certification) of the new sensing device can be input from thecertification information input unit 13 by the manager.

Subsequently, in step S109, the certification server 1 stores thegeneral item information and the certification standard of the input newsensing device in connection with each other in the certificationinformation DB 14.

In this way, the general item information and the certification standardof the new sensing device introduced in the system are registered. Then,when the new sensing device 2 (individual) is actually installed, thecertification server 1 certifies each sensing device 2. Hereinafter, thecertification process for the sensing device 2 (individual) will bedescribed with reference to FIG. 7.

FIG. 7 is a sequence diagram illustrating a certification process forthe sensing device individual according to the embodiment. Asillustrated in FIG. 7, in step S123, the newly installed (or delivered)sensing device 2 (individual) first transmits property information(so-called performance information) regarding the sensing device 2necessary for certification to the certification server 1.

Next, in step S126, the certification unit 12 of the certificationserver 1 extracts the corresponding certification standard registered inthe certification information DB 14 on the basis of a model included inthe property information received from the sensing device 2 via thecommunication unit 11 and certifies the sensing device (individual) onthe basis of the certification standard.

Subsequently, when the certification standard is satisfied (“Yes” inS129), the certification unit 12 certifies the sensing device 2(individual) in step S132. Specifically, the certification unit 12stores the property information regarding the certified sensing device 2(registers the certified device) in the individual information DB 15 andstores a certification history of the sensing device 2 in the individualcertification history DB 16.

Subsequently, in step S135, the certification unit 12 generatesinformation (certification information) regarding the certified sensingdevice 2 and transmits the information to the emotion server 3. Thecertification information transmitted to the emotion server 3 is storedin the certification information DB 34 of the emotion server 3.

In addition, in step S138, the certification unit 12 also transmits thecertification information to the sensing device 2. The certificationinformation transmitted to the sensing device 2 is stored in thecertification information storage unit 24 of the sensing device 2.

Conversely, when the certification standard is not satisfied (“No” inS129), the certification unit 12 does not perform the certification.

The certification process at the time of installation (or the time ofdelivery) of the new sensing device has been described. In this way, inthe embodiment, it is possible to certify the sensing device 2 inadvance.

<3-2. Periodic Certification Process for Sensing Device>

In the above-described certification process, the fact that thecertification process is performed at the time of installation of thenew sensing device 2 has been described, but the embodiment is notlimited thereto. For example, the information processing system 100according to the embodiment can periodically acquire the propertyinformation from the sensing device 2, confirm the certification at thattime, and reexamine the certification. For example, in an example of thesensing device extracting an interaction through analysis of a capturedimage, it is necessary to reexamine the certification due to a reductionin a frame rate of image capturing and analysis. Hereinafter, theperiodic certification process will be described with reference to FIGS.8 and 9.

FIG. 8 is a sequence diagram illustrating the periodic certificationprocess according to the embodiment. As illustrated in FIG. 8, in stepS153, the sensing device 2 (individual) first periodically stores theproperty information regarding the sensing device 2 necessary forcertification.

Next, in step S156, the sensing device 2 transmits a history of theaccumulated property information (or property information obtained byaveraging histories) to the certification server 1.

Subsequently, in step S159, the certification unit 12 of thecertification server 1 preserves the received history of the propertyinformation in the individual information DB 15.

Next, in step S162, the certification unit 12 compares the receivedproperty information to a previous property history to determine whetherthe property information is changed.

Subsequently, when the property information is changed (“Yes” in S162),the certification unit 12 determines whether the received propertyinformation satisfies the certification standard in step S165.

Subsequently, when the property information does not satisfy thecertification standard (“No” in S165), the certification unit 12 rejectsthe certification of the sensing device 2 and updates a certificationstate of the sensing device 2 to be stored in the individual informationDB 15 to “rejection of certification” in step S168.

Next, in step S171, the certification unit 12 notifies the emotionserver 3 of the rejection of certification of the sensing device 2. Theemotion server 3 stores information regarding the rejection ofcertification in the certification information DB 34. The interactioninformation transmitted from the sensing device 2 of which thecertification is rejected is not authenticated by the authenticationunit 30 f and the emotion server 3 does not store (register) theinteraction information in the emotion information DB 33, so thatreliability of the emotion value (or the emotion information DB 33storing an evaluation value which is a component of the emotion value)can be maintained.

In addition, in step S174, the certification unit 12 also transmits therejection of certification to the sensing device 2. The sensing device 2stores the information regarding the rejection of certification in thecertification information storage unit 24. When the sensing device 2receives the rejection of certification, the sensing device 2 canmaintain reliability of a database (the emotion information DB 33)constructed on the side of the emotion server 3 by performing controlsuch that the interaction is not extracted and transmitted to theemotion server 3.

The rejection of certification of the sensing device 2 (individual) hasbeen described above. Also, when the certification of the sensing device2 (individual) is rejected, the certification server 1 may notify a userof the rejection of certification to provide the user with anopportunity to determine registration or non-registration of theinteraction. For example, the user may be notified of the rejection ofcertification using a mail address of the user registered in theindividual information DB 15 as individual information regarding thesensing device 2 (individual).

In addition, when the individual certification is rejected in this way,the information processing system 100 according to the embodiment mayfurther confirm the certification of the same model as the individual ofwhich the certification is rejected. Hereinafter, the description willbe made with reference to FIG. 9.

FIG. 9 is a flowchart illustrating a certification confirmation processwhen certification is rejected. As illustrated in FIG. 9, in step S203,the certification unit 12 of the certification server 1 first acquirescertification states of all the sensing devices 2 of the same model asthe rejected sensing device 2 (individual). Specifically, thecertification unit 12 acquires certification information regarding thesensing devices 2 with the same model as a target from the individualinformation DB 15.

Next, in step S206, the certification unit 12 determines whether otherindividuals are also certified with a given certification standard.

Subsequently, when the other individuals with the same model are notcertified either (No in S206), the certification unit 12 updates acertification state of the model of the target to “rejection ofcertification” in the certification information DB 14 in step S209. Thereason for this update is to reject the certification of all theindividuals of the model of the target since there is a possibility of adefect occurring in all the sensing devices 2 of the model when thecertification of one or more of the individuals of the same model isrejected.

Next, in step S212, the certification unit 12 updates the certificationstate of each individual of the model of the target to “rejection ofcertification” in the individual information DB 15.

Subsequently, in step S215, the certification unit 12 notifies theemotion server 3 of the rejection of certification of the model of thetarget. The emotion server 3 stores the received information regardingthe rejection of certification in the certification information DB 34.The interaction information transmitted from the sensing device 2 of themodel of which the certification is rejected is not authenticated by theauthentication unit 30 f and the emotion server 3 does not store(register) the interaction information in the emotion information DB 33,so that reliability of the emotion value (or the emotion information DB33 storing an evaluation value which is a component of the emotionvalue) can be maintained.

Then, in step S218, the certification unit 12 notifies each sensingdevice 2 of the model of the target of the rejection of certification ofthe model. The sensing device 2 stores the information regarding therejection of certification in the certification information storage unit24. When the sensing device 2 receives the rejection of certification,the sensing device 2 can maintain reliability of the database (theemotion information DB 33) constructed on the side of the emotion server3 by performing control such that the interaction is not extracted andtransmitted to the emotion server 3.

<3-3. Certification Process in Accordance with Feedback>

Next, a certification process for the sensing device 2 in accordancewith feedback from a user will be described with reference to FIG. 10.FIG. 10 is a sequence diagram illustrating the certification process forthe sensing device in accordance with feedback of the user according tothe embodiment.

As illustrated in FIG. 10, in step S253, the interaction extraction unit22 of the sensing device 2 extracts an interaction on the basis ofsensing data detected by the sensor 21.

Subsequently, in step S256, the communication unit 23 of the sensingdevice 2 transmits the interaction information to the emotion server 3.

Subsequently, in step S259, the interaction storage controller 30 a ofthe emotion server 3 stores (registers) the received interactioninformation in the emotion information DB 33.

Subsequently, in step S262, the user terminal 5 requests the emotionserver 3 a to browse the interaction information regarding the usercarrying the user terminal 5. The request for browsing the interactioninformation may be given automatically or in accordance with a usermanipulation. In addition, when the user terminal 5 requests the emotionserver 3 to browse the interaction information, the user terminal 5designates an object ID of the user.

Subsequently, in step S265, the notification controller 30 g of theemotion server 3 extracts the interaction information corresponding tothe designated object ID of the user from the emotion information DB 33and transmits the interaction information to the user terminal 5. Also,the interaction information includes identification information such asthe individual ID of the sensing device 2 detecting the interaction.

Subsequently, in step S268, the user terminal 5 displays the receivedinteraction information on a display unit (not illustrated).

Subsequently, in step S271, the user terminal 5 accepts an evaluationinput (feedback input) of validity of the interaction by the user.Specifically, the user evaluates whether detection of the interaction bythe sensing device 2 is normally performed. The evaluation may be madewith indexes of 1 to 10, for example.

Subsequently, in step S274, the user terminal 5 transmits the inputevaluation to the certification server 1 (feedback).

Subsequently, in step S277, the certification unit 12 of thecertification server 1 preserves the evaluation received from the userterminal 5 via the communication unit 11 in the individual certificationhistory DB 16 in connection with the corresponding sensing device 2(individual).

Subsequently, in step S280, the certification unit 12 certifies thecorresponding sensing device 2 (individual) on the basis of theevaluation from the user. For example, when the evaluation by the useris input with indexes of 1 to 10 and the evaluation is equal to or lessthan a predetermined value, the certification unit 12 rejects thecertification.

Subsequently, when it is determined that the certification does notcontinue, that is, it is determined that the certification is rejected(“No” in S283), the certification unit 12 updates the certificationstate of the sensing device 2 (individual) corresponding to theindividual certification history DB 16 to “rejection of certification”in step S286.

Subsequently, in step S289, the certification unit 12 notifies theemotion server 3 of the rejection of certification.

Then, in step S292, the certification unit 12 notifies the sensingdevice 2 of the rejection of certification.

Conversely, when it is determined that the certification continues(“Yes” in S283), the certification unit 12 does not change thecertification state of the corresponding sensing device 2.

The certification process for the sensing device 2 in accordance withthe feedback by the user has been described specifically above. Also,the same model of the sensing device 2 of which the certification isrejected in the certification process may similarly be subjected to thecertification confirmation process illustrated in FIG. 9. In addition,in the above-described certification process, the user terminal 5requests the emotion server 3 to browse the interaction information (seeS262), but the embodiment is not limited thereto. For example, theemotion server 3 may request the user terminal 5 to evaluate theinteraction information.

<3-4. Certification Process Based on Interaction Evaluation Value>

Next, another certification process according to the embodiment will bedescribed. FIG. 11 is an explanatory diagram illustrating a case inwhich a plurality of sensing devices 2A to 2E detect the sameinteraction. As illustrated in FIG. 11, for example, when a certain usertalks with another user, conversation between the users is detected asan interaction at the same timing by the plurality of sensing devices 2Ato 2E in the environment. The sensing device 2A detects an interactionby acquiring sound and analyzing the sound and the sensing devices 2B to2D detects interactions by analyzing captured images. In addition, thesensing device 2E detects an interaction by analyzing a captured image,sound, biometric information (a heart rate, brain waves, bodytemperature, a pulse rate, an amount of perspiration, or the like)received from a wearable device worn by the user.

Then, since the sensing devices 2A to 2D transmit the detectedinteraction information to the emotion server 3, the emotion server 3registers the interaction information in the emotion information DB 33and the evaluation unit 30 b calculates evaluation values of theinteractions. At this time, the emotion server 3 compares the evaluationvalues of the interactions to each other. When there is a considerablydifferent value, it can be determined that there is a problem in thesensing device 2 detecting the interaction, the certification server 1is notified that there is a problem, and the certification can beamended by the certification server 1.

Hereinafter, a notification process based on the evaluation values bythe emotion server 3 will be described specifically with reference toFIG. 12. FIG. 12 is a flowchart illustrating the notification processaccording to the embodiment.

As illustrated in FIG. 12, in step S303, the emotion server 3 firstacquires the interaction information regarding the same interaction fromthe plurality of sensing devices 2.

Subsequently, in step S306, the interaction storage controller 30 a ofthe emotion server 3 stores (registers) the plurality of pieces ofinteraction information regarding the same interaction in the emotioninformation DB 33.

Subsequently, in step S309, the evaluation unit 30 b calculates theevaluation values of the plurality of pieces of interaction information.

Subsequently, in step S312, the controller 30 compares the evaluationvalues of the plurality of interaction information to each other.Specifically, the controller 30 extracts an evaluation value of aconsiderable numerical value among the evaluation values, that is, anevaluation value with which a difference from the other evaluationvalues of the plurality of evaluation values of the plurality of piecesof interaction information exceeds a predetermined threshold.

Subsequently, when the difference between the evaluation values exceedsthe predetermined value (“Yes” in S315), the notification controller 30g performs control in step S318 such that the certification server 1 isnotified that there is a problem in the sensing device 2 detecting theinteraction information of the evaluation value in which there is adifference exceeding the predetermined threshold. Thus, in thecertification server 1, the certification of the pointed sensing device2 may be rejected or the property information regarding the pointedsensing device 2 may be acquired and the certification may be confirmedin comparison with the certification standard.

The notification process based on the evaluation value according to theembodiment has been described specifically above.

<3-5. Approval Process>

In the above-described embodiment, the certification of the sensingdevice 2 has been described. By certifying the sensing device 2 by thecertification server 1, it is possible to maintain the reliability ofthe emotion value. Here, the operation process of the informationprocessing system according to the embodiment is not limited to theabove-described certification process. By registering the interactioninformation certified among the pieces of interaction informationextracted by the sensing device 2 certified by the certification server1 in the emotion server 3, it is also possible to improve thereliability of the emotion value.

For example, the sensing device 2 may also recognize a face expressionof a user in addition to an interaction in which the user cleans awatch, as illustrated in FIG. 1, through image analysis. However, acertain user does not want an interaction of an emotion by a faceexpression in a life at his or her home to be registered in the emotionserver 3. Accordingly, in the embodiment, control is enabled such thatcertified interaction information is registered in the emotion server 3.Hereinafter, the approval process will be described with reference toFIGS. 13 to 18.

3-5-1. Approval Process

FIG. 13 is a flowchart illustrating the approval process according tothe embodiment. As illustrated in FIG. 13, in step S323, thenotification controller 30 g of the emotion server 3 first notifies theuser of presence of the sensing device 2 which can detect an interactionof a target user with reference to the certification information storedin the certification information DB 34. Specifically, the notificationcontroller 30 g notifies the user terminal 5 of presence of the sensingdevices 2 which are the sensing device 2 worn by the user, the sensingdevice 2 installed at the home of the user, and the sensing device 2carried to be loaded by the user and are the sensing devices 2 certifiedby the certification server 1. The emotion server 3 may perform thenotification when the certification is performed by the certificationserver 1 and the certification information is transmitted or may performthe notification in accordance with access from the user terminal 5.

Subsequently, in step S333, the emotion server 3 receives approvalinformation indicating sensing or non-sensing by the user. Specifically,the user performs approval setting of detection of an interactionbetween the user and another object by the notified sensing device 2 andthe user terminal 5 transmits approval information indicating content ofthe approval setting to the emotion server 3.

Subsequently, in step S336, the controller 30 of the emotion server 3stores the approval information received from the user terminal 5 inconnection with the approval information of the corresponding sensingdevice 2 stored in the approval information DB 34 and transmits theapproval information to the corresponding sensing device 2. The approvalinformation includes an object ID of the target user setting theapproval and the individual ID of the approved sensing device 2. Thesensing device 2 detects an interaction of the target user when theinteraction detection is approved by the user, and does not detect aninteraction of the target user when the interaction detection is notapproved. In addition, in the emotion server 3, the interaction storagecontroller 30 a performs control such that the received interactioninformation is stored (registered) in the emotion information DB 33 in acase in which the registration is certified by the certification server1 and is approved by the target user with reference to the certificationinformation and the approval information stored in the certificationinformation DB 34 when the received interaction information is stored(registered) in the emotion information DB 33.

The approval process of the sensing or the non-sensing by the user hasbeen described specifically above. Thus, an interaction can be detectedby the sensing device 2 approved by the user among the certified sensingdevices 2 and the detected interaction information can be stored in theemotion server 3. Accordingly, for example, an interaction such asconversation may be detected. However, when the user does not want aninteraction such as a face expression to be detected, registration of aninteraction not desired by the user can be avoided by approving thesensing device 2 collecting sound and not approving the sensing device 2acquiring a captured image.

In addition, the approval information may be managed by the emotionserver 3 or may be managed by the certification server 1, as describedabove or a server managing the approval information may be separatelyinstalled.

3-5-2. Approval Setting in Each Place

In the above-described approval process, the approval of the sensingdevice 2 which is around the target user and detects the interaction ofthe user has been described, but the embodiment is not limited thereto.For example, interaction detection can also be approved temporarily tothe sensing device 2 installed in a public place which the user does notusually visit. Thus, for example, in a conference room of a businessoffice, a restaurant, an event site, or the like, a user entering thatplace can be notified of registration or non-registration of aninteraction in that place and approval setting can be appropriatelyperformed. Hereinafter, the description will be made specifically withreference to FIG. 14.

FIG. 14 is a flowchart illustrating an approval setting process in eachplace according to the embodiment. As illustrated in FIG. 14, in stepS343, the emotion server 3 first determines whether there is a new userwithin a predetermined range. The predetermined range is, for example, apublic place such as a conference room of a business office, arestaurant, or an event site, as described above. The sensing device 2which detects an interaction of an object within the predetermined rangeand is certified by the certification server 1 is installed in thatplace. When there is an approval of the user, the interactioninformation can be registered in the emotion server 3. For example, ahuman detection sensor (which may be the sensing device 2) installed atan entrance can also detect people going in and out and determine thepresence of a new user on the basis of the detection result.Alternatively, the presence of a new user may also be determined on thebasis of positional information of the user terminal 5 and installationplace information of the sensing device 2 installed in a public place.The installation place information of the sensing device 2 is includedin the certification information stored in the certification informationDB 34. In addition, the sensing device 2 installed in a public place mayascertain the presence of a new user by acquiring user identificationinformation (for example, an object ID) from the user terminal 5 or mayascertain the presence of a new user by imaging the face of the user andrecognizing a face image.

Subsequently, in step S346, the notification controller 30 g of theemotion server 3 notifies the user of presence of the certified sensingdevice 2 detecting an interaction within the predetermined range.Specifically, the notification controller 30 g notifies the userterminal 5 of the user entering the predetermined range of the presenceof the sensing device 2.

Subsequently, in step S349, the emotion server 3 receives the approvalinformation of the sensing or non-sensing by the user. Specifically, theuser uses the user terminal 5 to perform approval setting of whether aninteraction between the user and another object may be detected withinthe predetermined range, and then the user terminal 5 transmits inputapproval information to the emotion server 3.

Then, in step S352, the controller 30 of the emotion server 3 stores theapproval information received from the user terminal 5 in connectionwith the certification information of the corresponding sensing device 2stored in the certification information DB 34 and transmits the approvalinformation to the corresponding sensing device 2. The sensing device 2detects an interaction of the target user when the sensing device 2 isapproved by the user, and does not detect an interaction of the targetuser when the sensing device 2 is not approved. In addition, in theemotion server 3, the interaction storage controller 30 a performscontrol such that the received interaction information is stored(registered) in the emotion information DB 33 in a case in which theregistration is certified by the certification server 1 and is approvedby the target user with reference to the certification information andthe approval information stored in the certification information DB 34when the received interaction information is stored (registered) in theemotion information DB 33.

Thus, the user can approve the detection of the interaction by thecertified sensing device 2 which can detect an interaction within thepredetermined range in a public place or the like at that place.

3-5-3. Automatic Approval Setting of Surrounding Sensing Device

In the above-described approval setting process in each place, the userperforms the approval setting of the sensing device 2. However, whenthere are many sensing devices 2 around the user, it takes some time forthe user to perform the approval setting in each of the sensing devicesand thus there is a burden on the user. Accordingly, the sensing devices2 around the user may be automatically approved on the basis ofpositional information of the user. Hereinafter, the automatic approvalsetting will be described with reference to FIG. 15.

FIG. 15 is a flowchart illustrating an automatic approval settingprocess for surrounding sensing devices according to the embodiment. Asillustrated in FIG. 15, in step S363, the approval setting unit 30 h ofthe emotion server 3 first performs approval setting indicating that thesensing devices 2 around the user may detect an interaction of a targetuser. The approval setting may be performed in accordance with aninstruction from the target user. In addition, the set approvalinformation includes an object ID of the target user and the individualID of the sensing device 2 worn by the user.

Subsequently, in step S366, the emotion server 3 acquires currentpositional information of the user. Specifically, the emotion server 3acquires current positional information of the user terminal 5 measuredby a position measurement unit such as a GPS installed in the userterminal 5 from the user terminal 5.

Subsequently, in step S369, the approval setting unit 30 h of theemotion server 3 searches for one or more sensing devices 2 around theuser on the basis of the current positional information. Specifically,the approval setting unit 30 h searches for the certified sensingdevices 2 around the user with reference to the installation positionalinformation of the sensing devices 2 included in the certificationinformation stored in the certification information DB 34.

Then, in step S372, the approval setting unit 30 h approves thedetection of an interaction of the target user to the one or more foundsensing devices 2. Specifically, the approval setting unit 30 hgenerates approval information indicating approval of the interactiondetection of the target user to the one or more found sensing devices 2and stores the approval information in the approval information DB 34.In addition, the notification controller 30 g may notify thecorresponding sensing device 2 of the generated approval information.

The automatic approval setting process for the surrounding sensingdevices 2 according to the embodiment has been described above. In thisway, by performing the setting indicating the approval of the sensingdevices 2 around the user in advance, it is possible to perform theapproval setting on one or more sensing devices 2 automatically inaccordance with the current position of the user, and thus it ispossible to omit the trouble of the user.

3-5-4. Operation Process of Sensing Device 2 in Accordance with ApprovalSetting

Next, a process of interaction detection in each sensing device 2 whenthe above-described approval setting is performed will be described withreference to FIG. 16. FIG. 16 is a flowchart illustrating an operationprocess of the sensing device 2 in accordance with the approval settingaccording to the embodiment.

As illustrated in FIG. 16, in step S383, the sensing device 2 firstacquires the object ID of a target (an article or a person) detected bythe sensor 21. Specifically, for example, the sensing device 2 mayinquire of the emotion server 3 on the basis of sound analysis oranalysis of a captured image obtained by imaging the target and mayacquire the corresponding object ID managed in the object DB 32. Inaddition, the sensing device 2 may acquire the object ID from the target(for example, the user terminal 5 carried by the target user).

Subsequently, in step S386, the sensing device 2 confirms approvalsetting of sensing of the target indicated by the acquired object ID inthe emotion server 3. Specifically, for example, the sensing device 2designates the object ID and the individual ID of the sensing device 2,inquires of the emotion server 3, and acquires the correspondingapproval information stored in the certification information DB 34. Thesensing device 2 confirms whether detection of an interaction of thetarget is approved with reference to the approval information.

Subsequently, when the detection of the interaction is approved (“Yes”in S389), the sensing device 2 detects the interaction of the target andtransmits the interaction of the target to the emotion server 3 in stepS392.

Conversely, when the detection of the interaction is not approved (“No”in S389), the sensing device 2 does not detect the interaction of thetarget in step S395.

The operation process of the sensing device 2 in accordance with theapproval setting according to the embodiment has been describedspecifically above.

3-5-5. Supplement

In the automatic approval setting of the surrounding sensing devices 2around the user, as described above with reference to FIG. 15, theapproval setting is automatically performed on one or more sensingdevises 2 around the user on the basis of the positional information ofthe user and the interaction information is registered. However, theembodiment is not limited thereto. When the surrounding sensing devices2 is approved and then a given condition is satisfied, control may beperformed such that interaction information from the surrounding sensingdevices 2 is registered (stored in the emotion information DB 33).

FIG. 17 is an explanatory diagram illustrating registration ofinteraction information from surrounding sensing devices when a givencondition is satisfied according to the embodiment. As illustrated inFIG. 17, for example, a sensing device 2F which is worn by the user andcan recognize sound transmits current positional information to theemotion server 3. The approval setting unit 30 h of the emotion server 3searches for other sensing devices 2G, 2H, and 2I around the user on thebasis of the current positional information of the user and approvesdetection of an interaction of the user in regard to the found sensingdevices 2.

Subsequently, when a conversation interaction of the user is detected bythe sensing device 2F and the user continues conversation with anotherperson for a predetermined time, the emotion server 3 registers theinteraction information transmitted from the surrounding sensing devices2G to 21. Conversely, when the sensing device 2F does not detect theconversation interaction of the user, the emotion server 3 discards theinteraction information transmitted from the surrounding sensing devices2G to 21 and does not perform the registration. In this way, in theembodiment, when detection of the interaction information by thesurrounding sensing devices 2G to 21 is approved and then theregistration of the interaction information from the surrounding sensingdevices 2 is approved in accordance with, for example, a given conditionthat the interaction is detected by the sensing device 2 worn by theuser. Hereinafter, the registration approval process will be describedspecifically with reference to FIG. 18.

FIG. 18 is a flowchart illustrating the registration approval processaccording to the embodiment. As illustrated in FIG. 18, in step S403,the approval setting unit 30 h of the emotion server 3 first performsapproval setting of registration of interaction information of a userdetected by surrounding sensing devices in advance when the sensingdevice worn by the user (who is an example of a target including aperson or an article) detects the interaction. The approval setting maybe performed in accordance with an instruction from the user, forexample. In addition, the set approval information includes an object IDof the target user and an individual ID of the sensing device worn bythe user.

Subsequently, in step S406, the emotion server 3 acquires currentpositional information of the user.

Subsequently, in step S409, the approval setting unit 30 h of theemotion server 3 searches for one or more sensing devices 2 around theuser on the basis of the current positional information. Specifically,the approval setting unit 30 h searches for the certified sensingdevices 2G to 21 around the user with reference to the installationpositional information of the sensing devices 2 included in thecertification information stored in the certification information DB 34.

Subsequently, in step S412, the approval setting unit 30 h approvesdetection of an interaction of the target user in regard to the foundsensing devices 2G to 21.

Subsequently, in step S415, the emotion server 3 receives theinteraction information of the user detected by the approved sensingdevices 2G to 21 around the user.

Subsequently, in step S418, the interaction storage controller 30 a ofthe emotion server 3 determines whether the sensing device 2F worn bythe user detects an interaction and the interaction information istransmitted to the emotion server 3. Here, for example, it is determinedwhether a conversation interaction between the user and another user isdetected for a given time and is transmitted as interaction information.

Then, when the sensing device 2F worn by the user transmits theinteraction information (“Yes” in S418), the interaction storagecontroller 30 a of the emotion server 3 performs control such that theinteraction information received from the surrounding sensing devices 2Gto 21 is registered in the emotion information DB 33 in step S421.

Conversely, when the sensing device 2F worn by the user does nottransmit the interaction information (“No” in S418), the interactionstorage controller 30 a of the emotion server 3 discards the interactioninformation received from the surrounding sensing devices 2G to 21 anddoes not perform the registration in step S424.

The registration approval process for the interaction information fromthe sensing devices 2 around the target has been described above as thesupplement of the approval process according to the embodiment.

<3-6. Access Approval Process>

The above-described certification process and approval process areprocesses related to a stage in which the interaction information isregistered in the emotion server 3, and the maintenance of thereliability of the database constructed in the emotion server 3 isrealized through the processes.

Here, an interaction evaluation value is assigned to the interactioninformation registered in the emotion server 3 by the above-describedevaluation value 30 b and an emotion value is calculated on the basis ofthe evaluation value by the emotion value calculation unit 30 e.Specifically, the emotion server 3 calculates an emotion value of anobject ID designated from an external device and outputs the emotionvalue to the external device. In addition, the emotion server 3 outputsthe interaction information or the evaluation value of the object IDdesignated by an external device to the external device and the externaldevice calculates the emotion value in some cases.

The external device can use the acquired emotion value in variousinformation processing systems. For example, the emotion value can alsobe used in an environment adjustment system that causes a moving targetuser to follow a moving object and causes the moving object to locallychange a surrounding environment in accordance with the emotion of thetarget user. The environment adjustment system will be describedspecifically with reference to FIG. 19.

FIG. 19 is an explanatory diagram illustrating an environment adjustmentsystem in which an emotion value is used according to the embodiment. Asillustrated in FIG. 19, a moving object 6 is a small-sized unmannedflying object that follows a target user Obj.X (who is an example of anobject) and moves and can locally change a surrounding environment inaccordance with an emotion of the target user. Specifically, when thetarget user has an unpleasant emotion against rain, the moving object 6functions as a rain shelter while flying above the target user so thatthe target user does not get wet with the rain. When the target user hasan unpleasant emotion to direct sunlight exposure or sunburn, the movingobject 6 similarly functions as a sunshade.

In addition, the moving object 6 analyzes a captured image of the targetuser captured by a loaded camera, recognizes the target user Obj.X and awatch Obj.Y (which is an example of an object) worn by the target userObj.X, and inquires of the emotion server 3 about a relative emotionvalue of the user Obj.X to the watch Obj.Y. The emotion valuecalculation unit 30 e of the emotion server 3 calculates the relativeemotion value of the user Obj.X to the watch Obj.Y on the basis of anevaluation value of a previous interaction occurring between the userObj.X and the watch Obj.Y. In the emotion server 3, a mood of the targetuser valuing the watch is calculated as an emotion value, for example,on the basis of evaluation values of interactions “frequent maintenance”and “safekeeping in a dedicated case” in regard to the watch Obj.Ycarried by the target user Obj.X.

Then, when the relative emotion value of the user Obj.X to the watchObj.Y is acquired from the emotion server 3, the moving object 6performs control such that a coverage range of the rain shelter/thesunshade by the moving object 6 is expanded or the target user iscovered more preferentially than the watch in accordance with theemotion value (the degree of valuing) of the target user to the watch.Also, in the example illustrated in FIG. 19, the moving object 6directly requests the emotion server 3 to acquire the emotion value, butthe environment adjustment system is not limited thereto. An environmentcontrol server (not illustrated) controlling the moving object 6 mayrequest the emotion server 3 to acquire the emotion value. In this case,the environment control server performs object recognition based onanalysis of a captured image, or flying control of the moving object 6or environment adjustment control by the moving object 6.

In this way, the emotion server 3 outputs the emotion value (or aninteraction evaluation value) of a designated object in accordance withaccess from the moving object 6 or an external device such as anenvironment control server controlling the moving object 6. However, asillustrated in FIG. 19, it is necessary to prevent an unauthorized thirdperson from acquiring the emotion value (or an interaction evaluationvalue) of the target user by unauthorized access to the emotion server3.

Accordingly, in the embodiment, by performing control such that theemotion server 3 outputs an emotion value (or an interaction evaluationvalue) of a target user only in a case of access from an external devicethat has predetermined authority, it is possible to further improve thereliability of the emotion server 3. Hereinafter, an operation processaccording to the embodiment will be described with reference to FIG. 20.

3-6-1. Access Permission Process

FIG. 20 is a sequence diagram illustrating an access permission processaccording to the embodiment. Here, a case in which a user calls themoving object 6 to use the moving object 6 as a rain shelter will beassumed.

As illustrated in FIG. 20, in step S503, the user first acquires theobject ID of the moving object 6 permitted to acquire the emotion valueusing the user terminal 5.

Subsequently, in step S506, the user terminal 5 designates the object IDof the moving object 6 and requests the emotion server 3 to setpermission of access to the emotion value of the user.

Subsequently, in step S509, the access permission setting unit 30 i ofthe emotion server 3 performs permission setting in accordance with therequest from the user terminal 5. Specifically, the access permissionsetting unit 30 i generates permission information indicating permissionof access to information such as the interaction information, theevaluation value, and the emotion value of the user from the designatedobject ID and stores the permission information in the permissioninformation DB 35. In this way, in the embodiment, the user sets theaccess permission in advance in the moving object 6.

Subsequently, in step S512, the user calls the moving object 6 using theuser terminal 5.

Subsequently, in step S515, the moving object 6 called from the useracquires the object ID of the target user who is a calling subject. Theobject ID of the target user may be transmitted from the user terminal 5when the moving object 6 is called (S512).

Subsequently, in step S518, the moving object 6 designates the object IDof the target user and requests the emotion value of the target user. Inaddition, when belongings worn by the target user is recognized, themoving object 6 may also request a relative emotion value of the targetuser to an object ID of the belongings together.

Subsequently, in step S521, referring to the permission information DB35, the controller 30 of the emotion server 3 confirms whether theaccess to the emotion value of the target user by the moving object 6 ispermitted. Specifically, referring to the permission information, thecontroller 30 determines whether the access to the target user ispermitted on the basis of the object ID of the moving object 6.

Subsequently, when the access is not permitted (“No” in S521), theemotion server 3 notifies the moving object 6 that the emotion value ofthe target user is not acquirable in step S524.

Conversely, when the access is permitted (“Yes” in S521), the emotionserver 3 transmits the emotion value of the target user to the movingobject 6 in step S527.

As described above, by setting the emotion server 3 so that the accessto the emotion value of the user is permitted in advance to the movingobject 6 (which is an example of an external device), it is possible toprevent the emotion value from being acquired by the access by anunauthorized third person.

3-6-2. Modification Example

In the above-described access permission process, the user permits aspecific external device to acquire the emotion value of the user, butthe emotion vale permitted to be acquired may be limited. For example,when the emotion value is used in the environment adjustment system, itis possible to realize control of a coverage range of a rainshelter/sunshade as long as the moving object 6 can acquire relativeemotion values of the target user to objects (belongings worn by thetarget user or peoples staying together) around the target user.Accordingly, by permitting another access permission process accordingto the embodiment only to access to the relative emotion values of theuser to objects around the user, it is possible to avoid outputting anunnecessary emotion value. Hereinafter, the access permission processwill be described with reference to FIG. 21.

FIG. 21 is a sequence diagram illustrating another access approvalprocess according to the embodiment. Also, in steps illustrated in FIG.21, the same reference numerals are given to the same steps as theaccess permission process described with reference to FIG. 20.

As illustrated in FIG. 21, in step S503, the user first acquires theobject ID of the moving object 6 permitted to acquire the emotion valueusing the user terminal 5.

Subsequently, in step S507, the user terminal 5 designates the object IDof the moving object 6 and requests the emotion server 3 to setpermission of access to specific emotion values of the user by themoving object 6. Specifically, the user terminal 5 requests the emotionserver 3 to set the permission of access to only the relative emotionvalues of the user to the objects (belongings worn by the target user orpeople staying together) around the user.

Subsequently, in step S509, the access permission setting unit 30 i ofthe emotion server 3 performs the permission setting in accordance withthe request from the user terminal 5.

Subsequently, in step S512, the user calls the moving object 6 using theuser terminal 5.

Subsequently, in step S515, the moving object 6 called from the useracquires the object ID of the target user which is a calling subject.

Subsequently, in step S516, the moving object 6 acquires the object IDof an object around the target user, for example, the watch Obj.Y wornby the user Obj.X, as illustrated in FIG. 19.

Subsequently, in step S519, the moving object 6 designates the object IDof the target user Obj.X and requests the relative emotion value of theuser to the watch Obj.Y (which is specified with the object ID of thewatch Obj.Y and also referred to as the object Y below).

Subsequently, in step S521, referring to the permission information DB35, the controller 30 of the emotion server 3 confirms whether theaccess to the emotion value of the target user by the moving object 6 ispermitted.

Subsequently, when the access is not permitted (“No” in S521), theemotion server 3 notifies the moving object 6 that the emotion value ofthe target user is not acquirable in step S524.

Conversely, when the access is permitted (“Yes” in S521), the controller30 of the emotion server 3 confirms whether the access to the specificemotion values of the target user by the moving object 6, that is, therelative emotion values to the objects around the target user, ispermitted, referring to the permission information DB 35, in step S525.

Subsequently, when the access is not permitted (“No” in S525), theemotion server 3 notifies the moving object 6 that the emotion value ofthe target user is not acquirable in step S528.

Conversely, when the access is permitted (“Yes” in S525), the controller30 of the emotion server 3 confirms whether the object Y is around thetarget user in step S531. For example, the controller 30 can confirmwhether the object Y is around the target user on the basis of acaptured image of the target user transmitted from the moving object 6.Alternatively, the controller 30 may confirm whether the object Y isaround the target user referring to positional information acquired by aposition measurement unit loaded on the object Y and positionalinformation transmitted from the user terminal 5.

Subsequently, when there is no object Y around the target user (“No” inS531), the emotion server 3 notifies the moving object 6 in step S534that the emotion value of the target user is not acquirable.

Conversely, when the object Y is around the target user (“Yes” in S531),the emotion server 3 transmits the relative emotion value of the targetuser to the object Y to the moving object 6 in step S537.

4. CONCLUSION

As described above, in the information processing system according tothe embodiment of the present disclosure, it is possible to maintain thereliability of the database constructed in the emotion server 3. In thedatabase, the interaction evaluation value for calculating the emotionvalue is stored in connection with the interaction information. Bymaintaining the reliability of the interaction information registered inthe database, it is possible to consequently the reliability of theevaluation value and the calculated emotion value and maintain thereliability of the entire system.

Specifically, for example, by including the certification server 1 thatcertifies the sensing device 2 detecting the interaction informationregistered in the emotion server 3 in the system, it is possible toprevent registration of incorrect interaction information due to anerroneous operation of the sensing device 2 and maintain the reliabilityof the emotion value. The sensing device 2 can be certified on the basisof feedback of the evaluation to the sensing device 2, for example, bynotifying the user of the registered interaction information andconfirming whether the interaction of the user is correctly detected. Inaddition, the sensing device 2 can be certified on the basis of whetherthe performance of the sensing device 2 (individual) satisfies thecertification standard at the time of installation or delivery.

In addition, by performing control such that the interaction informationapproved for each object ID, each type of interaction, or each placeamong the pieces of interaction information detected by the certifiedsensing device 2 is registered in the emotion server 3, it is possibleto improve the reliability of the emotion server 3.

In addition, by preventing unauthorized access to the emotion server 3by a third person, it is possible to further improve the reliability ofthe emotion server 3.

The preferred embodiment(s) of the present disclosure has/have beendescribed above with reference to the accompanying drawings, whilst thepresent disclosure is not limited to the above examples. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

For example, it is also possible to generate a computer program causingthe hardware such as the CPU, the ROM, and the RAM contained in thecertification server 1, the sensing device 2, the emotion server 3, orthe user terminal 5 described above to function as the certificationserver 1, the sensing device 2, the emotion server 3, or the userterminal 5. In addition, a computer-readable storage medium storing thecomputer program is also provided.

In the example illustrated in FIG. 2, the certification server 1 and theemotion server 3 have been described as separate servers, but theinformation processing system according to the embodiment is not limitedthereto. The certification server 1 and the emotion server 3 may also berealized by one information processing device.

Further, the effects described in this specification are merelyillustrative or exemplified effects, and are not limitative. That is,with or in the place of the above effects, the technology according tothe present disclosure may achieve other effects that are clear to thoseskilled in the art from the description of this specification.

Additionally, the present technology may also be configured as below.

(1)

An information processing system including:

a communication unit configured to acquire information related to aninteraction between objects from a sensing device that detects theinteraction between the objects;

an emotion information database constructed by accumulating anevaluation value used when an emotion value of each object generated onthe basis of the information related to the interaction between theobjects is calculated;

a certification unit configured to certify the sensing device thatdetects the interaction between the objects and issue certificationinformation to the sensing device; and

an authentication unit configured to authenticate the informationrelated to the interaction transmitted from the sensing device on thebasis of the certification information issued to the sensing device.

(2)

The information processing system according to (1),

in which the information related to the interaction authenticated by theauthentication unit and the evaluation value corresponding to theinteraction are accumulated in the emotion information database.

(3)

The information processing system according to (1) or (2), furtherincluding:

a notification controller configured to perform control such that a userrelated to the interaction is notified of the information related to theinteraction between the objects detected by a specific sensing devicevia the communication unit,

in which the certification unit updates certification informationregarding the specific sensing device in accordance with user feedbackon the information related to the interaction.

(4)

The information processing system according to (1) or (2), furtherincluding:

a notification controller configured to perform control such thatevaluation values corresponding to a plurality of interactions arecompared to each other when the same interaction is detected by theplurality of sensing devices, the sensing device that detects aninteraction to which an evaluation value deviating by a predeterminedthreshold or more is assigned is specified, and the certification unitis notified of the sensing device,

in which the certification unit updates the certification informationregarding the specified sensing device.

(5)

The information processing system according to any one of (1) to (4),further including:

an approval setting unit configured to approve interaction detection oraccumulation of the information related to the interaction in theemotion information database.

(6)

The information processing system according to (5),

in which the approval setting unit sets approval of the interactiondetection or the accumulation for each object ID or type of interaction.

(7)

The information processing system according to (5) or (6),

in which the approval setting unit performs setting such that theinteraction detection of a specific user is approved in the sensingdevice considered to be detectable on the basis of a response ofdetection or non-detection by the specific user.

(8)

The information processing system according to any one of (5) to (7),

in which the approval setting unit performs setting such that theinteraction detection of a specific user within a predetermined range isapproved on the basis of a response of detection or non-detection by thespecific user located within the predetermined range.

(9)

The information processing system according to any one of (5) to (8),

in which the approval setting unit performs setting such that theinteraction detection of a specific user is automatically approved inone or more sensing devices disposed around the specific user on thebasis of positional information of the specific user.

(10)

The information processing system according to any one of (5) to (9),

in which the approval setting unit performs setting such that theinteraction detection of a specific user is automatically approved inone or more sensing devices disposed around the specific user when theinteraction detection is performed by a specific sensing device worn bythe specific user.

(11)

The information processing system according to any one of (1) to (10),further including:

a permission setting unit configured to permit acquisition of an emotionvalue of a specific user with respect to an object around the specificuser.

(12)

An information processing device including:

an extraction unit configured to extract information related to aninteraction between objects detected by a sensor in connection with eachobject;

a communication unit configured to transmit information regarding thesensor and the information related to the interaction detected by thesensor to a server including an emotion information database constructedby accumulating an evaluation value used when an emotion value of eachobject generated on the basis of the information related to theinteraction between the objects is calculated; and

a certification information storage unit configured to receivecertification information indicating a result obtained when the servercertifies an information processing device including the sensor on thebasis of the information related to the interaction detected by thesensor via the communication unit, and store the certificationinformation.

(13)

The information processing device according to (12),

in which in a case where the server certifies the transmission of theinformation related to the interaction between the objects to theserver, the information processing device detects the interaction usingthe sensor in accordance with the certification information receivedfrom the server.

(14)

The information processing device according to (12) or (13),

in which the communication unit receives approval information forapproving interaction detection of a specific object with respect to oneor more information processing devices disposed around the informationprocessing device from the server, and

the information processing device detects interaction of the specificobject using the sensor in accordance with the approval informationreceived from the server.

(15)

A control method including:

acquiring information related to an interaction between objects from asensing device that detects the interaction between the objects;

constructing an emotion information database by accumulating anevaluation value used when an emotion value of each object generated onthe basis of the information related to the interaction between theobjects is calculated;

certifying, by a certification unit, the sensing device that detects theinteraction between the objects and issuing certification information tothe sensing device; and

authenticating, by an authentication unit, the information related tothe interaction transmitted from the sensing device on the basis of thecertification information issued to the sensing device.

(16)

A storage medium having a program stored therein, the program causing acomputer to function as:

an extraction unit configured to extract information related to aninteraction between objects detected by a sensor in connection with eachobject;

a communication unit configured to transmit information regarding thesensor and the information related to the interaction detected by thesensor to a server including an emotion information database constructedby accumulating an evaluation value used when an emotion value of eachobject generated on the basis of the information related to theinteraction between the objects is calculated; and

a certification information storage unit configured to receivecertification information indicating a result obtained when the servercertifies an information processing device including the sensor on thebasis of the information related to the interaction detected by thesensor via the communication unit, and store the certificationinformation.

REFERENCE SIGNS LIST

-   100 information processing system-   1 certification server-   11 communication unit-   12 certification unit-   13 certification information input unit-   14 certification information DB-   15 individual information DB-   16 individual certification history DB-   2 sensing device-   21 sensor-   22 interaction extraction unit-   23 communication unit-   24 certification information storage unit-   3 emotion server-   30 controller-   30 a interaction storage controller-   30 b evaluation unit-   30 c object management unit-   30 d related object search unit-   30 e emotion value calculation unit-   30 f authentication unit-   30 g notification controller-   30 h approval setting unit-   30 i access permission setting unit-   31 communication unit-   32 object DB-   33 emotion information DB-   34 certification information DB-   35 permission information DB-   4 network-   5 user terminal-   6 moving object

1. A control method, comprising: in an information processing device:calculating an evaluation value of an interaction between a plurality ofobjects, wherein the interaction between the plurality of objects isdetected by a sensing device; calculating an emotion value of eachobject of the plurality of objects based on the evaluation value of theinteraction between the plurality of objects; certifying the sensingdevice that detects the interaction between the plurality of objects,wherein the sensing device is certified based on user feedback on theinteraction; issuing certification information to the sensing devicebased on the certification of the sensing device; and authenticatinginformation related to the interaction, wherein the information isauthenticated based on the certification information.
 2. The controlmethod according to claim 1, further comprising setting an approval ofthe detection of the interaction between the plurality of objects foreach of an object identification (ID) and a type of the interaction. 3.The control method according to claim 1, further comprising accumulatingthe evaluation value in an emotion information database.
 4. The controlmethod according to claim 2, further comprising approving accumulationof the information related to the interaction in an emotion informationdatabase.
 5. The control method according to claim 4, further comprisingsetting an approval of the accumulation of the information, related tothe interaction, for at least one of the object ID or the type of theinteraction.
 6. The control method according to claim 4, furthercomprising approving the detection of the interaction of an object ofthe plurality of objects for the sensing device, wherein the objectcorresponds to a specific user, and the detection of the interaction ofthe specific user is approved based on an approval operation of thespecific user.
 7. The control method according to claim 4, furthercomprising approving the detection of the interaction of an object ofthe plurality of objects within a specific location, wherein the objectcorresponds to a specific user, and the detection of the interaction ofthe specific user within the specific location is approved based on anapproval operation of the specific user.
 8. The control method accordingto claim 4, further comprising setting an automatic approval of thedetection of the interaction of an object of the plurality of objectsfor the sensing device, wherein the object corresponds to a specificuser, the automatic approval of the detection of the interaction isbased on positional information of the specific user, and the sensingdevice is within a proximity of the specific user.
 9. The control methodaccording to claim 1, further comprising acquiring an emotion value of aspecific user with respect to a specific object of the plurality ofobjects, wherein the specific object is within a proximity of thespecific user.